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0 Communication system using trellis coded 0AM. 

® Coded modulation schemes based on codes for QPSK modulation are directly, incorporated into QAM based 
modulation systems, forming trellis coded QAM. to provide a practical coding structure '^^^ ^^^^^^^^^^^^ 
bandwidth and data reliability. Concatenated coding with QPSK based treli.s cod.ng and symtK)! 
coding is used. In an encoder (Fig. 2). an N-bit QAM constellation pattern (80) is divided .nlo four sublets , 
including N/4 symbol points of the constellation pattern. A two-bil QPSK codeword (92) .s assigned to each of 
the four'subsels (82. 84, 86. 88). A symbol to be transmitted is first encoded using ^^'^^^^^^^^^^^^ 
encoding algorithm, such as a Reed-Solomon code (12). Part of the symbol .s then encoded (48) - ^^^^^ 
^. code that comprises a rale 1/2 trellis encoding algorithm to provide a QPSK codeword, wh.ch s -^^Ppe^^^^^^^^^ 
^ with the remaining bits of the symbol to provide a modulation function, where.n the remaining bits (94) correlate 
< Tsymb^l with one of the sym'bol points included in the subset defined by the ^.^^^ ^^^^^^^^^^ 
^ (Fig. 3). the recovered modulation function is pruned (62) to provide a set ol metrics (66) ^o/^^fP^^^'^Q »° 
J^i subsets and to provide a plurality of conditional determinations of the constellal.on point .dent.f.ed by the 
^ em Jlg bU^^^^^^ metrics are used in a rate 1/2 trellis decoder (68) to recover a first bit that .s encoded us^^^^ 
^ a rate m encoding algorithm to recreate the QPSK codeword. One of a plurality of the cond.Uonal determma- 
S on is 1 ected in response to the recreated codeword. The selected conditional ^eterm.na on .s combined 
with the recovered first bit to provide a decoded output that is further decoded usmg a symbol error correcting 
^ algorithm such as a Reed-Solomon code (36), 
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BACKGROUND OF THE INVENTION 

The present invention relates lo trellis coded quadrature amplitude n^odulation (QAM) and more 

■ I— ^^^^^^^ 

and small bandwid.h occupancy requirements. QAM provides bandwidth ^"'1^;;^ 

On the other hand, modulation schemes such as quadrature phase f ''^^'"S^^'^f 

but have the same amplitude. Thus, the lour symbols are equally spaced about a crcle. 

QpIk modulation- is suitable lor power limited systems where bandwidth limitations are not a ma,or 

TreTl'is coied modulation (TCM) has evolved as a combined coding and modulation technique lor digital 
transmi ion overSnd limi ed channels. It allows the achievement o. '^"f '"^ 

,s onvTnti na, uncoded multilevel modulation, such as QAM. without -^'^^'^'I'^^e ^Te^^^^^^ 
TCM schemes utilize redundant nonbinary modulation in combination with a (in.te-slate '"" ^^ 

governs me ::tection o. modulation signals to generate coded signal 

Lnais are decoded bv a solt-decision maximum likelihood sequence decoder. Such schemes can improve 
.rr bust^esTofdiial transmission against additive noise by 3-6 dB or more, co^-^ to conven uo^ 
.0 uncoded modulation These gains are obtained without bandwidth ^''P^"^'^? "l^J^^^ ^i^"^ ZtZ 

„h««» OPSK i,chm,u«s «cl sirt componsnl. la.e M b.m M a.MWc. ™p 

.lh„ coded « '"''fJ'T.'lZT"^ ,.oy«e lo- cos. compoo.nls 

Fo, applioiioo. »a aro toll. po«r Mod aod bond l.m.ied ar«l 'W" »" " 
„ ,„,rte„l.r"«-. cost dau, d«^»). coo..«l~. 0«- Wsl.ms hav. ^^^,1 ^ 



3 



EP 0 525 641 A2 



provide a high quality compressed television picture. The bandwidth constraint is a consequence of the U.S. 
Federal Communications Commission requirement that HDTV signals occupy existing 6 MHz television 
channels, and must coexist with the current broadcast NTSC signals. This combination of data rate and 
bandwidth occupancy requires a modulation system that has high bandwidth efficiency. Indeed, the ratio of 

5 data rale to bandwidth must be on the order of 3 or 4. This means that modulation systems such as QPSK. 
having a bandwidth efficiency without coding of two. are unsuitable, A more bandwidth efficient modulation, 
such as QAM is required. However, as noted above, QAM systems have been too expensive to implement 
for higfi volume consumer applications. 
. The requirement for a very high data reliability in the HDTV application results from the fact that highly 

70 compressed source material (i.e., the compressed video) is intolerant of channel errors. The natural 
redundancy of the signal has been removed in order to obtain a concise description of the intrinsic value of 
the data. For example, for a system to transmit at 15 Mbps for a twenty-four hour period, with less than one 
bit error, requires the bit error rate (BER) of the system to be less than one error in 10'^ transmitted bits. 
Data reliability requirements are often met in practice via the use of a concatenated coding approach. 

15 which is a divide and concur approach to problem solving. In such a coding framework, two codes are 
employed. An "inner" modulalion code cleans up the channel and delivers a modest symbol error rate to 
an "outer- decoder. The inner code is usually a coded modulation that can be effectively decoded using 
"soft decisions" (i.e.. finely quantized channel data). A known approach is to use a convotutional or trellis 
code as the inner code with some form of the "Viterbi algorithm" as a trellis decoder. The outer code is 

20 most often a t-error-correcting. "Reed-Solomon" code. Such Reed-Solomon coding systems, that operate in 
the data rate range required for communicating HDTV data, are widely available and have been imple- 
mented in the integrated circuits of several vendors. The outer decoder removes the vast maiorily of 
symbol errors that have eluded the inner decoder in such a way that the final output error rate is extremely 
small. 

25 A more detailed explanation of concatenated coding schemes can be found in G. C. Clark. Jr. and J. B. 
Cain. "Error-Correction Coding for Digital Communications". Plenum Press. New York, .1981: and S. Lin and 
D, J. Costello. Jr.. "Error Control Coding: Fundamentals and Applications". Prentice-Hall. Englewood Cliffs. 
New Jersey. 1983. Trellis coding is discussed extensively in G. Ungerboeck. "Channel Coding with 
Multilevel/Phase Signals". IEEE Transactions on Information Theory . Vol. IT-28, No. 1. pp- 55-67. January 

30 1 982; G. Ungerboeck. "Trellis-Coded Modulation with Redundant Signal Sets - Part I: Introduction. -- Part 
II- State of the Art". I EEE Communications Magazine . Vol. 25. No. 2. pp. 5-21. February 1987; and A. R. 
Caulderbank and N, J. A. Sloane. "New Trellis Codes Based on Lattices and Cosets". IEEE Transactions on 
Information Theory. Vol. lT-33. No. 2. pp. 177-195. March 1987. The Viterbi algorithm is explained in G. D. 
Forney. Jr.. "The V iterbi Algorithm". Proceedings of the IEEE . Vol. 61. No. 3. March 1973. Reed-Solomon 

35 coding systems are discussed in the Clark. Jr. et at and Lin et al articles cited above. 

The error rale performance at the output of the inner, modulalion code in concatenated coded systems 
is highly dependent on signal-to-noise ratio (SNR). Some codes perform better, providing a lower error rate 
at a low SNR while others perform better al a high SNR. This means that the optimization of the modulation 
code for concatenated and nonconcatenaled coding systems can lead to different solutions, depending on 

40 the specified SNR range. 

It would be advantageous to provide a data modulalion system with high bandwidth efficiency and low 
power requirements. Such a system should provide a high data rale, with minimal bandwidth occupancy, 
and very high data reliability. The complexity of a receiver for use wilh such a system should be minimized, 
to provide low cost in volume production. Optimally, the system should be able to be implemented using 
45 readily available components wilh as little customization as possible. 

The present invention provides a modulation system having the aforementioned advantages. In 
particular, the method and apparatus of the present invention expand a trellis coded QPSK system to a 
trellis coded QAM system, without sacrificing data reliability. 

50 SUMMARY OF THE INVENTION 

In accordance with the present invention, a method is provided for communicating digital data using 
QAM transmission. An n-bit QAM constellation pattern is divided into four subsets. Each subset includes 
N/4 symbol points of the constellation pattern. A different two-bit codeword is assigned to each of the four 
55 subsets. A symbol to be transmitted is encoded by processing a first bit of the symbol w.th a rate 1/2 
binary convolutional encoding algorithm to provide the two-bit codeword assigned to the subset in which the 
symbol resides in the constellation pattern. The two-bit codeword is mapped with the remaining b'ts of the 
symbol to provide a modulation function. The remaining bits correlate the symbol wilh one of the N/4 
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symbol points included in the subset defined by the codeword. A carrier is modulated with the modulation 
function for transmission on a communication channel. . ^ , 

In an illustrated embodiment, the two-bit codeword forms the least significant b.ts ol the modulation 
function and defines the columns of a matrix of coordinates o( the constellation pattern. The remaining bUs 

5 form the most significant bits of the modulation function and determine the size of the constellation pattern 
In a concatenated approach, information bits are first encoded into symbols using, for example, a t-symbol 
error correcting code, such as a Reed-Solomon code. These encoded symbols are then passed to a trellis 
encoder which produces the desired modulation for a carrier. 

After the modulation function is transmitted, it is recovered at a receiver. The recovered modulation 

,0 function is pruned to provide a set of metrics corresponding to the subsets and to provide a plurality of 
bytes representing different conditional determinations of a signal point identified by the remaining bits. The 
metrics are used in an algorithm (such as the Viterbi algorithm) for decoding a rate 1/2 binary convolutional 
code to recover the first bit. The recovered first bit is encoded using a rate 1/2 binary convolutional 
encoding algorithm to recreate the codeword. One of the conditional determination bytes is selected .n 

;5 response to the recreated codeword. The selected byte is then combined with the recovered first bit to 

provide a decoded output. ^ . . < . • -^^^ tk^ 

The present invention also provides apparatus for encoding digital data for QAM transmission. The 
encoder includes means for parsing a symbol to be transmitted into a first bit and at least one rema.nmg 
bit Means are provided for encoding the first bit with a rate 1/2 binary convolutional encoding algorithm to 

20 provide a two-bit codeword that defines one of four subsets of an N-bil QAM constellation pattern, each 
subset including N/4 symbol points of the constellation pattern. The codeword is mapped with the remaining 
bits to provide a modulation function. The remaining bits correlate the symbol with one of the N/4 symbol 
points included in the subset defined by the codeword. Means are provided for modulating a carrier with the 
modulation function for transmission on a communication channel. An outer encoder can be provided for 

25 encoding information bits using an error correcting algorithm to provide the symbol that is parsed by the 

parsing means. ^ , . , 

In an illuslraled embodiment, the codeword forms the least significant bits of tho modulation (unction 
and defines the columns of a matrix of coordinates of said constellation pattern. The remaining bits (orm the 
most significant bits of the modulation function and determine the size of the constellation pattern. The 
30 encoding means can use a trellis coding algorithm. 

Decoding apparatus is also provided in accordance with the invention. A receiver demodulates a 
received carrier to recover an N-bil Om modulation function in which a two-bit codeword identifies one of a 
plurality of 0AM constellation subsets and the remaining (N-2) bit portion represents a signal point withiri 
said one subset. Ivleans are provided for pruning the recovered modulation function to provide a set ol 
35 metrics corresponding to said subsets and to provide a plurality of (N-2) bit subgroups representing a 
plurality of conditional determinations of the signal point Idenlified by the (N-2) bit portion. The metrics are 
used in an algorithm for decoding, a rate 1/2 binary convolutional code to recover a first bit. The recovered 
first bit is encoded using a rate 1/2 binary convolutional encoding algorithm to recreate the codeword^ 
Means are provided for selecting one of the plurality ol (N-2) bit subgroups in response to the recreated 
40 codeword. The selected subgroup is combined with the recovered first bit to provide a decoded output 

In an illustrated embodiment, the codeword comprises the least significant bits in the modulation 
function and defines the columns of a rnalrix of constellation coordinates, with the selected subgroup 
forming the most significant bits and defining a row of the matrix. The pruning means quantize he 
recovered N-bit modulation function for each column of a matrix of constellation coordinates and the 
« conditional determinations comprise a best choice lor each ol the columns «ilh Ihe set of melncs 
identifying the quality ol each choice. The metrics are used in conjunction with a decoder that uses a solt- 
decision algorithm for decoding convolutional codes. ^ ^ 

A concatenated decoder is also provided. In the concatenated embodiment, an outer decoder is 
provided for decoding the output using a symbol error correcting algorithm. In an illustrated embodimen . 
,0 the inner decoding algorithm used in the concatenated decoder comprises the Viterb. algonthm. The outer 
symbol error correcting algorithm can comprise a Reed-Solomon code. The carrier signal received by the 
receiver can comprise a high definition television carrier signal. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram ol a QAM transmission system employing concatenated coding: 
Figure 2 is a block diagram of a trellis encoder in accordance with the present invention; 
Figure 3 is a block diagram of a trellis decoder in accordance with the present invention; 
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Rgure 4 Is an illustration of a QAM constellation pattern divided into subsets in accordance with the 
present invention: 

Figure 5 is a diagram defining the labeling of subsets in the constellation pattern of Figure 4; 
Figure 6 Is a diagram illustrating the labeling of constellation points in the constellation pattern of Figure 
5 4; and 

Rgure 7 is a graph illustrating the performance of a concatenated coding scheme in accordance with the 
present invention as compared to a prior art coded QAf^ scheme. 

DETAILED DESCRIPTION OF THE INVENTION 

to 

Figure 1 iiluslrates a concatenated coding system for communicating OAI^ data. Digital information to 
be transmitted is input to a symbol error correcting coder 12. such as a Reed-Solomon encoder, via an 
input terminal 10, Encoder 12 converts the information Into a codeword 14. comprising a plurality of 
successive n-bit symbols 16. While an outer convolutional code could be used for encoder 12. the bursty 

;5 nature of the errors in a transmission system, the fact that only hard quantized data is available, and the 
desirability of a high rate code make a Reed-Solomon code, whose symbols , are formed from n-bil 
segments of the binary stream, a good choice for the outer code. Since the perlormance of a Reed- 
Solomon code only depends on the number of symbol errors in the block, such a code is undisturbed by 
burst errors within an n-bit symbol. However, the concatenated system perlormance is severely degraded 

20 by long bursts of symbol errors: Therefore, an inlerleaver 18 is provided at the output of Reed-Solomon 
encoder 12. to interleave the symbols (as opposed to individual bits) between coding operations. The intent 
of the interleaving Is to break up the bursts of symbol errors. 

The interleaved symbols are input to a QAM trellis coder 20. In accordance with the present invention, 
coder 20 incorporates a QPSK code into a trellis coded QAM modulation system, as described in greater 

25 detail below. 

The output of coder 20 comprises symbols representative of coordinates in the real (1) and imaginary 
(Q) planes of a QAM constellation pattern. One such constellation point 22 is symbolically illustrated in 
Figure 1. The symbols are transmitted by a conventional transmitter 24 via a communication channel 26. 
The communication channel introduces various distortions and delays that corrupt the signal before it is 

30 received by a receiver 28. As a result, the coordinate values embodied in the received symbols will not 
correlate exactly with the transmitted coordinate values, such that a received point 30 will end up on the 
constellation pattern in a different location than the actual trarismitted point 22. In order to determine the 
correct location for the received point, and thereby obtain the data as actually transmitted, the received data 
(T. Q) is input to a QAM trellis decoder 32 that uses a soft-decision convolutional decoding algorithm to 

35 recover the transmitted information. A decoder in accordance with the present invention is described in 
greater detail below. 

The decoded output from decoder 32 is input to a deinterleaver 34 that reverses the effects of 
interleaver 18 discussed above. The deinterleaved data is input to a Reed-Solomon decoder 36 for recovery 
of the original information bits. 

40 In the present invention, a QPSK code is incorporated into the trellis coded QAM modulation system to 
provide a high data rate, bandwidth efficient system with a moderate bit error rate in low SNR regions of 
operation. In order to achieve this result, the codewords of the QPSK code and the "uncoded" bits which 
together define a symbol are uniquely assigned to a QAM constellation. In addition, the received signal is 
decoded by a combination of a soft-decision decoder with techniques for deciding which constellation 

45 points the •'uncoded" bits refer to. 

Figure 2 illustrates an encoder in accordance with the present invention. Data bits (e.g., from inlerleaver 
18 - Figure 1) are input to a conventional parsing circuit 42 via an input terminal 40. An N-1 bit symbol to 
be transmitted is parsed into a first bit that is output on line 46 to a convolutional encoder 48. The 
remaining N-2 "lincoded" bits are output on line 44 to a 2^-QAM mapper 50. Convolutional encoder 48 

50 employs a rate 1/2, 64-state convolutional code, in which the generators are 171 and 133 in octal. The two 
bits output from encoder 48 and the N-2 uncoded bits (N bits total) are presented to the 2^-OAM mapper 
for use as labels to map the N-bit symbol to a specific constellation point on a QAM constellation. The two 
"coded" bits output from convolutional encoder 48 are actually QPSK codewords, and are used to select a 
constellation subset. The uncoded bits are used to select a specific signal point within the constellation 

55 subset from the QAM constellation. 

For purposes of QAM transmission (encoding), the codewords of the OPSk code and the remaining 
uncoded bits must be assigned to the QAM constellation. For this purpose, one must describe a labeling of 
QAM constellation points by a modulation function. MOD(m)iR^ 
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M00:{0. 1}**- R'. 

The mapping described below has the following desirable features: (1) the consequences of the 90' phase 
ambiguity of QAM is imposed on the QPSK codewords while the uncoded bits are invariant to the ambiguity 
(i.e., the 90* phase ambiguity can be dealt with in the same manner as the QPSK system) and (2) the most 
significant digits control the constellation size (i.e. a nested scheme (or 16/32/64 - QAf^). 

Consider the labeling described by the following matrix, for 16-QAM (nris = m, = 0) <and QPSK. ms = 
m4 = Mj = m2 = 0): 



MOD(mj mb mi /^j ) 










00 


0 1 


1 1 


1 0 


000 0 


^ 1 


-1.+ 


1 -1.-1 


.1.-1^ 


000 1 


+1.-3 


+3.+ 


1 -1. + 3 


-3. - 1 


00 11 


-3.-3 


+3. - 


3 +3. +3 


-3. +3 


00 10 


I, -3. + 1 


-1. - 


3 +3.-1 


+ 1,+3 / 



for 32-QAM (mj = 0) add: 











25 


4 


00 


0 1 


1 1 


10 




0 100 


^ +5. - 3 


+3. + 5 


-5. +3 


-3.-5\ 




0 10 1 


+1. + 5 


-5.+ 1 


-1,-5 


+5.-1 


30 


0 111 


+5.+ 1 


-1. + 5 


-5.- 1 


+1.-5 




0 110 


^ -3. + 5 


-5.-3 


+3.-5 


+5. + 3 / 




for 64-QAM add: 










35 












00 


0 1 


11 


1 0 


40 


1100 


^ +5. + 5 


-5. + 5 


-5.-5 


+5. - 5 


110 1 


+5.-7 


+7, + 5 


-5. + 7 


-7. - 5 




1111 


-7.-7 


+7.-7 


+7. + 7 


-7. + 7 




1 1 t 0 


-7. + 5 


-5.-7 


+7.-5 


+5. + 7 


4$ 


10 0 0 


-3. - 7 


+7.-3 


+0. + 7 


-7. + 3 




10 0 1 


-7. + 1 


-1.-7 


+7. - 1 


+ 1. + 7 




10 11 


+1.-7 


+7. + 1 


-1. + 7 


-7.- 1 


SO 


10 10 


^-7.-3 


+3.-7 


+7. + 3 


-3. + 7 / 



The outputs of the QPSK encoder form the least significant bits (LSBs). m,mo, of the modulator input, 
and select the column of the matrix. The most significant bits (f^SBs) determine the constellation size. W.th 
no uncoded bits (ms = = m, = m^ = 0). QPSK is generated. With 2 uncoded bits. mam,. IB-QAI^ is 
generated. With 3 uncoded bits, m^mjm,. 32-QAIVI is generated. With 4 uncoded bits, msm.m.m:. 64- 
OAfVl is generated. Furthermore, the effect of rotating the QAf^ constellation by 90 'is to rotate the columns 
of the matrix, 
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00 01 ^ 11 — 10 — 00; 

which leaves the rows invariant. This nneans the labeling of the uncoded bits is unaffected by 0 • , 90 ' . 

5 180* and 270* rotations. The handling of the 90* phase ambiguity at the receiver (decoder) is left solely to 
the QPSK encoder. Whatever method is used for resolving the ambiguity at the QPSK receiver can be 
directly incorporated into the QAM system using this labeling. For example, diflerenlta! encoding ol QPSK 
could be used if the QPSK code is itself rotationatly invariant, 
• The labeling of a 16-OAI^ and 32-QAM constellation pattern in accordance with the present invention is 

10 illustrated in diagrammatic form in Figure 4. The constellation patterns, generally designated 80, correspond 
to the 16-QAM and 32-QAM matrices given above. In particular, for the 16-QAM example, the 16 
constellation points are provided in a dashed box 90. The constellation points are divided into four subsets 
indicated by tokens 82, 84, 86, 88 as shown in Figure 5. Each subset contains four constellation points. 
Thus, lor subset 82 designated by an open circle, four points 82a, 82b, 82c. and 82d are provided within 

/5 box 90. The subset itself is defined by the two coded bits (QPSK bits) mO. ml as indicated at 92 of Figure 
6. For the 16-QAM implementation, the specific point within each subset is identified by the "uncoded" bits 
m2, m3 as indicated at 94 in Figure 6. Thus. 82c is defined as the 00 subset and the 01 1 point within that 
subset. Each remaining constellation point, such as points 84a. 86a. and 88a. are similarly identified. 

For a 32-bit QAM implementation, the additional 16 points outside of dashed box 90 are also included. 

20 These points are labeled similarly, with all three bits m2. m3. m4 designated at 94 in Figure 6 being used. It 
will be appreciated that the labeling set forth can be expanded to higher levels of QAM. 

A feature of the labeling scheme used in accordance with the present invention, as indicated in Figure 
5. is that the Hamming weight of each QPSK symbol equals the Euclidian weight divided by a factor x. 
where x corresponds to the (minimum distance)' between constellation points. In the present example, the 

25 constellation points illustrated in Figure 4 are provided at QAM levels of 1. -1. 3. -3. 5. -5 in each of the 
quadrature channels, and therefore the minimum distance between constellation points is two. such that the 
Hamnr^ing weight is equal to the Euclidian weight divided by 4. 

Figure 3 illustrates an implementation of a QAM trellis decoder in accordance with the present 
invention. The received symbol data is input to a pruner 62 via an input terminal 60. Pruner 62 processes 

30 tho recovered modulation function to provide a set of metrics corresponding to the subsets defined by the 
QPSK codewords, and to provide a plurality of (N-2) bit subgroups representing a plurality of conditional 
determinations of the signal point identified by the transmitted uncoded bits. In particular, four metrics are 
output on line 66 to a rale 1/2 64-state Viterbi decoder 68. Four sets of (N-2) bit conditional determinations 
are output on line 64. 

35 Pruner 62 can comprise a memory device, such as a programmable read only memory (PROM), that 
stores a look-up table containing precomputed sets of metrics and conditional determinations for different 
sets of input values (7, Q). The (7. Q) values are used to address the PROM to output the corresponding 
stored metrics and determinations. This allows a very high speed pruning operation. The Viterbi decoder 
uses an accumulated history of the metrics received from the pruner to decode the QPSK codewords. 

40 The Viterbi decoder 68 illustrated in Figure 3 can be a conventional rale 1/2 decoder that is available for 
use with conventional QPSK coding schemes. Thus, in order to Implement the decoder ol the present 
invention, a custom Viterbi decoder is not required to decode the ireilis codes. 

Consider the process of signal detection when a soft-decision QPSK decoder is incorporated in a 
system employing the previously described QAI^ modulator. First, in hard-decision detection of QPSK or 

4S QAM signals, the received signal. 

= + W,. 

is quantized, where the signal, x^. belongs to the QPSK or QAM constellation (i.e., in thejange ol MOD(m)) 
50 and w„ is the noise. The quantization function produces an estimate of both the signal, x^. and the data m. 
according to the relation, x, = MOD(m). For maximum likelihood detection (ML), the log-Iikelihood function. 
- log{p(yk I MOD{m))). is minimized over the possible messages, m < (0. I)" .where p(yi. | xO is the 
conditional probability of receiving y^ given that is transmitted. For random messages. ML detection 
minimizes the probability of error. The most common method of quantization is nearest (Euclidean) 
55 neighbor detection, which satisfies 
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lln - = ^ min^jjln - MOD(m)| 



20 



s Where IP is the Euclidean distance squared f..e.. the sum ot the squares). In Ihe case of additive Gaussian 

noise, nearest neighbor detection is ML. ^ ^ ^ . ,k» ^„ t^, t^r 

In coded QPSK and QAM systems, soft decision information should be provided to the decoder for 
effective decoding of the codeword. This soh-decislon inlormalion is often described as a symbol metric; 
this metric indicates the quality of deciding a particular symbol, a = MOD(m), was sent when y. .s 
10 received. For nearest neighbor decoding, the metric of choice is: 

metric(yk: m) = lyk - MOD(m)fl'. 

in practice, the metric itself is quantized (or purposes of implemenlatlon. In QPSK. (or example, for each 
,5 possible message, m.. m, . {0. 1}'. the nearest neighbor metric ly. - MOD(m.. mo)P .s the ML metric for 
additive Gaussian noise. , . , . . „ 

In trellis coded GAM modulation, based on a soft decision decodable QPSK code, four symbol medics 
must be supplied to the decoder, as well as (our conditional hard decisions. For nearest neighbor detection, 
lor each choice of mi. mo < {0. 1}^ 

melfic(XA; /tt,. mo) = min - MO0{m^,i, mz, rrh, mo)\\^; 

the conditional hard decision's correspond to the choice o( m„., m, thai obtain the minimum The 

process of determining the symbol metrics and conditional hard decisions is known as pruning. In treMis 
coded QAM. the uncoded bits appear as "parallel" branches of the trellis, and the computation of the 
symbol metrics and conditional hard decisions act to prune all but the single best branch from the set of 

parallel edges. . . j i. _ xi,„ 

Note that pruning is easily described in terms of the QAM modulation matrix presented above. The 
pruning operation simply involves quantizing the received symbol. Y», for each column of the malnx. The 
conditional hard decision is then the best choice (or each column and the metric corresponds to the quality 

of that decision. . ^ ik^ 

Once the pruning operation has been completed, the soft decision inlormation is presented to he 
decoder of the QPSK code. (During this time, the conditional hard decisions are stored waiUng for the 
QPSK decisions.) The QPSK decoder, using the soil decision inlormalion, decodes the QPSK information 

(ie the m,. mos). The remaining information (i.e., the m„., mjs) is then decided in a well known 

manner using Ihe decoded QPSK information and the previously stored conditional hard decisions. 

Note that il the QPSK decoder is ML (lor QPSK modulation) then the pruning/QPSK decoding method 
described is also ML. For example, if the QPSK code is a binary convolulional code with nearest neighbor 
(i.e.. Viterbi) decoding, then the QAM trellis decoding algorithm is also nearest neighbor (i.e.. finds the 
closest codeword to the received sequence). ^ ^ t. h„„«h<., 

In the embodiment illustrated in Figure 3. Ihe metrics output from pruner 62 are decoded by decoder 
68 to recover a single bit that corresponds to the single bit output on line 46 in the encoder of Figure 2 
This bit is re-encoded with a rate 1/2 64-slate convolulional encoder 70 (identical to encoder 48 m Figure 2 
to recreate the two-bit QPSK codeword. The recreated codeword is used to select one of "^^ 'our (N-2) bit 
subgroups output from the pruner. after Ihe subgroups have been delayed by a delay buffer 72 fo an 
amount of «me equal to Ihe delay introduced by decoder 68. The selected (N-2) bit ="bgroup is then 
combined with the recovered single bit from decoder 68 in a serializer 76. lo provide a trellis decoded 

""'"aI" noted in connection with Figure 1. the decoded output may exhibit a modest symbol error rate that 
must be further improved by an outer decoder. Thus, (uriher processing of the ''e-ded o >p , by 
deinterleaver 34 and a Reed-Solomon outer decoder 36 (Figure 1) is used to recover Ihe original 

'"'°rSima!e of Ihe output bit error rale, with a given input symbol error rate. 

Reed-Solomon code can be easily computed. An (extended) Beed-Solomon code, over the finite lield with q 
- 2- has oarameters (n„s k, I), where the blocklenglh n„ S Q + '■ '^e dimension, k - n«s - 2t, and the 
error:corLTon capTbnIty ts t eaors. For a memoryless. symbol error channel with input symbol error rate. 
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Pin. the output symbol error rate is bounded by: 
s Poot^(Vn,s)._S^^\i/ (l-Pi„ ) min(i + t, n.^) . 

Then, the output bit error rale is approximated by the formula: 
10 Pb-Pou.2'*V(2'-1) 

Also, if the / bit symbols of the Reed-Solomon code are composed of smaller, n bit symbols (e.g., the 
decoded symbols of a trellis coded OAI^ modulation) then the input error rate is: 

15 p,„ - 1 - (1 - Pmodr 

where p^od is the n bit symbol error rate. To guarantee a "memoryless" channel when coded modulation is 
employed, the use of interleaving is required. 

Rgure 7 illustrates the performance o! two concatenated systems, one employing conventional rale 2/3 

20 trellis codes and decoding, and the other using the rate 1/2 QPSK implementation of trellis coded QAM in 
accordance with the present invention. The graph of Figure 7 plots Reed-Solomon block error rate against 
the carrier-to-noise ratio (CNR) in the received signal. A block error (or codeword error) occurs if one or 
more m-bit symbols are in ei-ror in the block. Curve 100 represents the performance of a concatenated 
Reed-Solomon trellis coded 16-QAI^ system in accordance with the present invention, using a rale 1/2, 64- 

25 stale decoder. Curve 104 represents the performance of a similar system using trellis coded 32-QAM. 
Curve 102 represents the performance of a conventional trellis coded 16-QAtvl. rate 2/3. 16-state decoder. 
Curve 106 represents the performance of a conventional trellis coded 32-QAlvi rate 2/3.-16-siale decoder. 

The curves of Figure 7 were determined by using trellis coding simulation results to estimate the 
probability of an m-bit Reed-Solomon symbol being in error. PRSiym. and then calculaling the probability of a 

30 Reed-Solomon block error in accordance with the following formula: 



where L is the Reed-Solomon block length (number of m-bil symbols per block) and t is the number of 

Reed-Solomon symbol errors thai can be corrected per block. The 16-QAlvt system uses 1 16. 8-bit symbols 
40 per block, and the 32-QAI^ system uses 155. 8-bil symbols per block. Both Reed-Solomon codes can 

correct up to five, 8-bil Reed-Solomon symbols per block. 

The curves in Figure 7 show that if it is desired or necessary to operate the system below a certain 

CNR. then the trellis coding approach of the present invention, represented by curves 100. 104. is clearly 

the correct choice. Even at higher CNRs, however, the trellis coding approach of the present invention may 
45 still be a belter choice, because the trellis decoder apparatus can be produced in a more cost effective 

manner using a conventional QPSK Viterbi decoder chip. 

It should now be appreciated that the present invention provides a practical system for digital 

transmission of power and band limited signals, such as compressed high definition television signals. A 

coded modulation scheme based on codes for QPSK modulation is directly incorporated into a QAM based 
50 modulation system, forming trellis coded QAM. This provides an easily implementable structure that is both 

efficient in bandwidth and data reliability. 

Although the invention has been described in connection with specific embodiments thereof, those 

skilled in the art will appreciate that numerous adaptations and modifications may be made thereto without 

departing from the spirit and scope of the invention as. set forth in the claims. 

55 

Claims 

1. A method for communicating digital dala using QAM transmission comprising the steps of: 
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dividing an N-bit QAM conslellallon pattern into louf subsets, each subset including N/4 symbol 
points of said constellation pattern; 

assigning a dillerent two-bit codeword to each ol said (our subsets; 

encoding a symbol to be transmitted by processing a first bit of said symbol w,lh a ate t/2 b.na y 
convolutional encoding algorithm to provide the two-bit codeword assigned to the subset m wh,ch sa.d 
symbol resides in said constellation pattern; 

mapping said two-bit codeword with the remaining bits of said symbol to prov.de a modu a^on 
(unction wherein said remaining bits correlate said symbol with one o( the N/4 symbol points included 
in the subset defined by said codeword: and . , ^K,„noi 

modulating a carrier with said modulation function (or transmission on a communication channel. 

A method in accordance with claim 1 wherein: j j .• „, ,u„ 

laid two-bit codeword forms the least significant bits of said modulation function and defines the 

columns ol a matrix of coordinates of said constellation pattern; and iho 
said remaining bits form the most significant bits of said modulation (unction and determine the 

size oi said constellation pattern. 

I. A method in accordance with claim 1 or 2 comprising the further step of encoding inlormation bits 
using an error correcting encoding algorithm to provide said symbol. 

I. A method in accordance with claim 3 wherein said convolutional encoding step uses a trellis coding 
algorithm. 

i. A method in accordance.wilh any of the preceding claims comprising the further steps o(: 
receiving said carrier at a receiver; 

demodulating the received carrier at said receiver to recover said modulation (unction; _ 
pruning the recovered modulation (unction to provide a set of metrics corresponding to said 
subsets and to provide a plurality of bytes representing ditferent conditional determinations o( a signal 

point identified by the remaining bits; ,^^„„or ^airt 

using said metrics in an algorithm (or decoding a rate 1/2 binary convolutional code to recover said 

encoding the recovered (irst bit using a rate 1/2 binary convolutional encoding algorithm to recreate 

"'^electTng one of said conditional determination bytos in response to said recreated codeword; and 
combining said selected byte with the recovered first bit to provide a decoded output. 

6. A method in accordance with claim 5 comprising the further steps of: -h . ,„h„i ,„ h« 

encoding information bits using an error correcting encoding algonthm to provide said symbol to be 

transmitted; and ^ ^. , .... . 

(unher decoding said output using a symbol error correcting decoding algonthm. 

7. A method in accordance with claim 5 or 6 wherein said algorithm (or decoding is the Viterbi algorithm. 

8. Apparatus tor encoding digital data (or QAIWI transmission comprising: 

means for parsing a symboi to be transmitted into a (irst bit and at least one remaining b, 

meL,s (or encodU^g said first bit with a rate 1/2 binary convolutional encoding algonthm to prov.de 
a twrbil codeword Iha'defines one o( (our subsets o( an N-bit QAM constellation pattern, each subset 
includino NM symbol points of said constellation pattern; 

means (o mapping said codeword with said remaining bits to provide a modulation (unction 
wherein said remain^g bits correlate said symbol with one o( the N/4 symbol points included in the 
subset defined by said codeword; and . . 

means for modulating a carrier with said modulation (unction tor transmission on a communication 

channel. 

9. Apparatus in accordance with claim 6 further comprising an outer encoder for encoding information bits 
using an error correcting encoding algorithm to provide said symbol. 

10. Apparatus in accordance with claim 8 or 9 wherein: 
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said codeword forms the least signincanl bits of said modulation function and defines the columns 
of a matrix of coordinates of said constellation pattern; and 

said remaining bits form the most significant bits of said modulation function and determine the 
size of said constellation pattern. 

5 

11. Apparatus in accordance with one of claims 8 to 10 wherein said encoding means use a trellis coding 
algorithm. 

12. Apparatus for decoding QAM symbol data comprising: 

JO means for demodulating a received carrier to recover an N-bit QAM modulation function in which a 

two-bit codeword identifies one of a plurality of QAM constellation subsets and the remaining (N-2) bit 
portion represents a signal point within said one subset: 

means for pruning the recovered modulation function to provide a set of metrics corresponding to 
said subsets and to provide a plurality of {N-2) bit subgroups representing a plurality of conditional 
15 determinations of the signal point identified by the (N-2) bit portion; 

decoder means for using said metrics in an algorithm for decoding a rate 1/2 binary convolulional 
code to recover a first bit; 

means for encoding the recovered first bit using a rale 1/2 binary convolutional encoding algorithm 
to recreate said codeword; 

20 means for selecting one of said plurality of (N-2) bit subgroups in response to said recreated 

codeword: and 

means for combining the selected subgroup with the recovered first bit to provide a decoded 
output. 

25 13. Apparatus in accordance with claim 12 wherein said codeword comprises the least significant bits in 
said modulation function and defines a column of a matrix of constellation coordinates, with the 
selected subgroup forming the most significant bits and defining a row of said matrix. 

14. Apparatus in accordance with claim 12 or 13 wherein said pruning means quantize the recovered N-bit 
00 modulation function for each column of a matrix of constellation coordinates and said conditional 

determinations comprise a best choice for each of said columns with the set of metrics identifying the 
quality of each choice. 

15. Apparatus in accordance with one of claims 12 to 14 wherein said decoding means comprise a decoder 
35 that uses a soft decision algorithm for decoding convolutional codes. 

16. Apparatus in accordance with one o( claims 12 to 15 further comprising: 

an outer decoder for decoding said output using a symbol error correcting algorithm, 
whereby the combination o( said decoder means and said outer decoder form a concatenated 
40 decoder. 

17. A concatenated decoder in accordance with one of claims 12 to 16 wherein said decoding algorithm 
comprises the Viterbi algorithm. 

45 18. A concatenated decoder in accordance with claim 16 or 17 wherein said symbol error correcting 
algorithm comprises a Reed-Solomon code. 

19. A concatenated decoder in accordance with one of claims 12 to 18 wherein said carrier is an HDTV 
carrier signal. 

50 
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Practical Coding for QAM Transmission of HDTV 

Chris Heegard, Member. IEEE. Scott A. Lery. Member. IEEE, and Woo H. Paik. Member, IEEE 



Abstract^This paper describes a practical approach to dig- 
ital transmission of compressed HDTV. We demonstrate how 
modulation schemes based on QPSK modulation can be directly 
incorporated Into QAM-based modulation systems. We shall 
argue that this leads directly to an easily implementable structure 
that is both efficient in bandwidth and data reliability. 

The use of a concatenated code is known to provide an effective 
and practical approach to achieving low BER, high data rate, and 
modest implementation complexity. It is our contention that the 
correct solution to the concatenated coding problem for HDTV 
transmission is to simply extend the modulation codes developed 
for QPSK - to - QA.M modulation. 

In nonconcatenated situations, a trellis code based on a binary 
cr at rate 2/3 is usually best; this fact follows from the study 
ot ...e asymptotic coding gain of a trellis code. However, this is 
not the case for higher error rates at the output of the trellis 
decoder (e.g., when a symbol error correcting decoder follows 
as in a concatenated code). The reason for this follows from an 
analysis of the effect of the number of "nearest neighbors" on 
the error rate. nncv 
A four-way partition of QAM is a natural extension of QPSK 
modulation; it is a simple matter to incorporate any good QPSK 
code into a trellis coding scheme for QAM modulation. We 
propose a concatenated coding scheme based on QPSK trellis 
codes and symbol error correcting coding: A specific example is 
presented which shows the advantages of this approach. 

I. iNTKODUCnON 

THIS paper describes a practical approach to the digital 
transmission of compressed high definition television 
(HDTV). The transmission system for this application has the 
following requirements. 

• Data rate: 15-30 Mb/s 

• Bandwidth occupancy: 6 MHz <j 
Data reliability: one error event per minute /6 

• Receiver complexity: low cost in volume production 
The data rate requirement arises from. the need to provide 

a high-quality compressed television picture. The bandwidth 
cons^traint is a consequence of the U.S. Federal Communi- 
cations Commission (FCC) requirement that HDTV signals 
occupy existing television channels; they must coexist with 
the current broadcast National Television System Committee 
(NTSC) signals. This combination of data rate and bandwidth 
occupancy requires a modulation system that has high band- 
width efficiency: the number of transmitted bits per second 
per unit of bandwidth (i.e.. the ratio of data rate to bandwidth) 
must be on the order of 3 to 5. this means that modulation 
systems such as quadrature phase shift keying (QPSK). a 

Manuscripc received June 1992: revised August 1992. 

C. Hecgard is with the School of Electrical Engineering. ComcU Univcraiiy. 
Uhaca. NY. _ , 

S. Lery ind W. H. Paik are with the VidcoCipher Division. General 
Initnjmcnt Corporation. San Diego. CA 92121. 

IEEE Log Number 92OJ-109. 



common scheme for satellite transmission systems (which are 
usually "power limited"), is unsuitable because its Jianslwidlh 
efficiency without coding is 2, A more bandwidth-efficient 
modulation-(for"bandlimitcd" transmission-like terrestrial and 
cable video systems), most notably quadrature amplitude mod- 
ulation (QAM), is required. 

On the other hand, since QPSK systems arc so well estab- 
lished, coded modulation schemes for such systems are well 
understood and routinely implemented. Typically, a binary 
convolutional code at rate 1/2 (or the same code "punctured" to 
some higher rate (1 1). [12]) is incorporated as the modulation 
code. As a consequence, integrated circuits that realize trellis- 
coded QPSK modulation are readily available and easily 
obtained. In this paper, we demonstrate how modulation 
schemes based on QPSK modulation can be directly incor- 
porated in QAM-based modulation systems. We shall argue 
that this leads directly to an implementable stixicture that is 
both efficient in bandwidth and data reliability. 

The need for very high data reliability follows from the 
fact that highly compressed source material (i.e., compressed 
video) is intolerant of channel errors; the natural redundancy 
of the signal has been removed in order to obtain a concise 
description of the intrinsic value of the source data. 

Low error rate requirements are met in practice via the use 
of a concatenated coding approach (divide and conquer), as 
depicted in Fig. I. In such a coding framework, two codes 
are employed: an "inner" modulation code and an "outer" 
symbol error-correcting code. The inner code is usually a 
"£odcdjnodulation" that can be effectively decoded using 
iiecUions" (i.e.. finely quantized channel data). The inner code 
"cleans up" the channel and exploits the soft decision nature 
of the received signal. The output of the inner code delivers 
a small (but unacccpiably high) symbol error rate to the outer 
decoder. This second decoder then removes the vast majority 
of symbol errors that have eluded the inner decoder in such a 
way that the final output error rate is extremely small. 

The standard concatenated coding approach is to use a. 
convolutional or trellis code [l], [2]. [4], (7H9] as the inner 
code with some form of the Viterbi algorithm [3] as the irelhs 
decoder. The outer code is most often a "i error correcting" 
Reed-Solomon code [2], [4] over a finite field'with 2*i symbols 
(q is usually on the order of 5-10). Such Reed-Solomon 
coding systems, that operate in the required data rate range, are 
widely available and have been implemented in the integrated 
circuits of several vendors. 

The optimization of the modulation code for concatenated 
and nonconcatenated coding systems can lead to different 
solutions. In a concatenated coding system, one needs to 
consider the required error rate of the modulation (inner) 
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Fig. 1. QAM transmission system using concaienaicd coding. 



code to achieve a specified bit or block (codeword) er- 
ror rate from the outer code. In a nonconcatenatcd coding 
system, the required error rate of the modulation code is 
usually much lower than in a concatenated coding system. 
For example, modulation code A may perform belter at "low" 
signal-to-noisc ratio (SNR) where the error rate is "large" 
than modulation code B, which performs better at "high" 
SNR where the eaor rate is "small." Code A may be the 
better choice for a concatenated coding system, and code 
B may be the better choice for a nonconcaccnated coding 
system. 

In light of this, it is our contention that simple extensions . 
of modulation codes developed for QPSK-to-QAM modula- 
tion provide the correct solution to the concatenated cod- 
ing problem. This is true even though these extensions arc 
known to be weaker than other known modulation codes 
used in nonconcaienated systems (i.e., when used in the 
domain where the output error rate of the modulation code 
is "small"). 

The organization of this paper is as follows. In Section 
II, a brief description of trellis/modulation coding is given. 
In Section III. the optimization of coding gain for trellis 
codes used in concatenated and noriconcatenated systems 
is discussed. In Section IV, QPSK-based trellis codes are 
described in detail, along with a trellis decoder implementa- 
tion. In Section V, performance comparisons between QPSK- 
based trellis codes and Ungerboeck codes are shown with 
and without outer coding. A short summary in Section VI 
concludes the paper. 

II. TRELLIS/ Modulation Coding 
In uncoded QAM transmission, n bits per symbol arc 
transmitted by mapping n data bits onto the 2^^ points of a 



QAM constellation. Thus, in the uncoded case, the number 
of data bits is equal to the number of input bits of the 
QAM modulator N = n. In a trellis code [1], [!]-[% the 
constellation is expanded by one bit (i.e., the constellation 
size is doubled), and the number of data bits per symbol is 
one less than the number of input bits of the QAM modulator 
N = n + 1. This expansion of the signal constellation 
is what allows for a coding gain to be achieved (i.e.. it 
allows for redundancy to be introduced in the transmitted 
signal).' 

A two-dimensional trellis code for the transmission of n 
bits per QAM symbol is obtained by the combination of an 
n-bit input, an n + i bit output, a ?*^-5;tate finite state machine, 
.(ESMI(i.e., encoder), and an /V = n + 1 bit QAM mapper 
(i.e., a 2'*' point QAM mapper/modulator), as depicted in Fig. 
2. As discovered by Ungerboeck [7], the most economical 
approach to this problem involves two components. The signal 
constellation is partitioned into 2*^""" subsets, each of size 
2"*, in such a way that the distance between points within 
each subset is maximized.^ The n input bits are split into 
k "coded" bits and m = n - "uncoded" bits. The k-b'a 
coded data is then encoded by a FSM with 1 output bits 
(i.e., redundancy in lime is introduced) and used to select the 
subset, while the m-bit uncoded data is used to select the point 
within the subset selected by the FSM. One way of labeling 
the QAM constellation points, corresponding to a mapping of 
the n -t- 1 bits to a QAM constellation point, is described in 
(7]-(9]. 

'In the "pragmatic" approach described in [10], QAM modulation Is 
obuincd from the one -dimensional PAM model. This approach leads to 
a quadnipling of Chc QAM signal constellation .V = n + 2. In many 
ipplications. this extra expansion is undesirable. 

'Caulderbank and Sloane [I) have shown that Ungerboeck's meihod of sei 
partitioning is best described in lerms of lattices and their coKcts. 
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III. Coding Gain 

• A. Asymptotic Coding Gain 

In nonconcatcnatcd situations, a trellis code based on a 
binary code at rate 2/3 (not a punctured rate 1/2 code) is 
usually the best solution.' This fact follows from the study 
of the asymptotic coding gain (ACG) of a trellis code. 

The ACG, 7, of a QAM-bascd trellis code is given by [8] 



7 = 



_ <f^^^^(coded)/jE;c(<;oded) 



A2/£:c(uncoded) 



(1) 



where Ec fcoded^ and Ecfuncodp H) denote the average-£Qa- 
stellation^eP «rrgjg <: of the coded and uncoded sch emes, re- 
spectively, and An ■'^ rh f - mi ni m ii m spacing of theJ ^AM, 
constellation points. The free Euclidean distance of the trellis 
code is given by (8] 

4^^(coded) = A^, min {^^eP^^^'^''')!'^''''^ 



(2) 



where the Euclidean distance of the FSM (i.e.. the convolu- 
tional encoder) is tf^^(.^.(FSM(/:, t/)). The free distance of the 
FSM depends on the structure of the encoder. 

For a given number of encoder slates parameterized by 
u and the number of inputs given by k, the encoders that 
maximize the FSM free distance have been tabulated for small 
values of u [\], (8). The results show why = 2 (i.e., an 
encoder FSM at rate 2/3) is the most practical for maximizing 
the ACG. For a given value of k and small i/, the ACG is 
determined by the FSM 

However, because the ACG involves a minimurn as the 
complexity of the encoder (as measured by u) is allowed to 
grow, it becomes 



increases with increasing k. Now from [9] it is seen that, fdr 
QAM trellis coding. = 2 and i/'(2) = 7, Thus.i0i_a 
f^,.,--u/i^ Y pa^'tinn f jL j=^L-r aie 1/2 encoding) , the ma ximiim. 
ACn fftqiifll to -^.01 dB) is achieved with four states while, 
for a p eighr.way partition ffc = ^ rate 2/3 encoding), .the 
maximum ACG feoual to 6J)2 jim is achieved with 128 states. 
Note that since the complexity of the decoder (with Vjterbi 
decoding [2]. (4], [7]) depends on the number of states of the 
encoder, a 16- way partition (k - 3, rate 3/4 encoding) may 
not be practical since the number of states required to achieve 
a large ACG might be prohibitive. 

5. Optimization of Coding Gain 

The conclusion from the above discussion is that if the ACG 
is to be maximized, then the obvious practical choice for trellis 
coding is an eight-way partition of the QAM constellation with 
a rate 2/3 encoder. Furthermore, in nonconcatenated systems, 
where the output error rate of the trellis code is to be small, 
maximizing the ACG is the appropriate thing to do. However, 
this is not the case for higher error rates at the output of the 
trellis decoder (e.g.. when a symbol error correcting decoder 
follows). The reason for this follows from an analysis of the 
effect on the caor rate of the number of "nearest neighbors." 

The probability of error. Psym, at the output of the trellis 
decoder can be predicted by the behavior of the formula [6]. 
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_ £c(uncoded) ^fc^.i 
^" £c(coded) 



rsym 



r df,,,(coded) 1 



(5) 



n/7P 1 



y2Ec(uncoded) J 



(6) 



(4) 



Thus, for a given value of fc. there is a natural value of 
trellis complexity u'{k) such that the ACG is not improved 
by making t/ > u'{k}. We note that t/*(fc) is monotonically 
increasing in k, since the rate of the encoder k/{k + 1) 

^This assumes a two-dimensional trellis code (31. 



or, using (1) and (2), 

Psyrn^ MnnQlA, 

where the (J -function is 

Q(x) = exp {-yV2) rfy. 

M„n is the average number of nearest neighbors, TVp is the 
one-sided spectral density of the additive Gaussian noise, and 
p is the signal-io-noise ratio (i.e., the energy per transmitted 
symbol divided No)- 

For *'high" signal-to-noise ratio p, the error probability is 
more seriously effected by the ACG, 7. than the number of 
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nearest neighbors Mnn- However, in the domain of "low" p, 
this is simply not the case; the number of the nearest neighbors 
has a significant effect. Thus, a code with a smaller ACG and 
smaller A/„„ may be more reliable than a code optimized for 
(he ACG. 

For example, for the rate 2/3 32-QAM Ungerboeck code 
with 16 states, the ACG is 4.77 dB [9]. However, the number 
of nearest neighbors is estimated to be 56 (91. On the other 
hand, if a strong QPSK-based code modulation code is used 
with a four- way partition of 32-0 AM. the ACG is only 3.01 
HB y^t f>^f n umber of nearest n ri^^'b^''^ \^ ") (The free 
distance of this code is determined by the "uncoded" bits. 
A four-way partition of 32-QAM yields four subsets, each 
with eight points. Among these eight points, five have two 
nearest neighbors, two have three nearest neighbors, and one 
has four nearest neighbors. So the average number of nearest 
neighbors is 2.5.) For low signal-to-noise ratios, the latter code 
has a smaller probability of error. f ' ?' 7 ' r 

It is (his simple realization that leads to (he conclusion 
that, in fac(. a four- way partition with t/ ^ ^''(1) = 2 is 
a very efficient method of trellis coding in a concatenated 
coding system. Furthermore, a four-way partition of QAM is a 
natural extension of QPSK modulation. It is a simple matter to 
incorporate any good QPSK code into a trellis coding scheme 
for QAM modulation. 

IV. Practical QPSK-Based Trellis Code 

Two issues showing how a QPSK code is incorporated into 
a QAM modulation system are detailed. The first addresses 
transmission (encoding): how the "codewords" of the QPSK 
code and the "uncoded" bits are assigned to the QAM con- 
stellation. The method described has the following desirable 
features: I) it addresses the 90° phase ambiguity of QAM; and 
2) the most significant digits control the constellation size. The 
second issue involves the decoder: how the received signal is 
prepared for decoding by the soft-decision QPSK decoder, and 
how the "uncoded" bits are decided. 

A. Labeling of QAM Points 

For purposes of QAM transmission, the codewords of the 
QPSK code and the uncoded bits must be assigned to the 
QAM constellation. This is accomplished by labeling the QAM 
constellation points by a modulation function MOD (m) e H^, 

(mod:){0,l}'^-fi-. 

The method described has the following desirable features: 
1) the consequences of the 90° phase ambiguity of QAM is 
imposed on the QPSK codewords, while the, tincodgd hits are 
i avariantj n an^hicjiiry (i.e.. the 90** phase ambiguity can 
be dealt with in the same manner as the QPSK system); and 2) 
the most significant digits control the constellation size (i.e., 
a nested scheme for 16/32/64-QAM). 

Consider the labeling (modulation function MOD(m)) 
given in Fig. 3. and depicted in Fig. 4. The outputs of the 
QPSK encoder form the least significant bits (LSB's). rfii.mo, 
of the constellation label; the LSB's select the column of 
the matrix. The most significant bits (MSB's) determine the 



ON SELECTED AREAS IN COMMUNICATIONS, VOL. II. NO. I. J.\NUARY 1993 

constellation size. With no uncoded bits, QPSK is generated: 
with two iincoded bits. 16-QAM is generated; with three 
uncoded bits. 32-QAM is generated; and with four uncoded 
bits. 64-QAM is generated. Furthermore, the^&fi^uiLJjiLxQUling 
rhP.Q&M rnngrplUtin^ hy Qfl^ ig In mt^ the column*; ofjthe 
matrix 

00 ^01 ^11 -.10 -^00 

which leaves the rows invariant. Thus, the .label of the uncoded 
bits is unaffected by 90° rotations. The handling of the 90" 
phase ambiguity at the receiver (decoder) is left solely to 
the QPSK encoder. The same method used to resolve the 
ambiguity with a QPSK receiver can be incoiporated into 
the QAM system using this labeling. For cxarnple, differential 
encoding could be used if the QPSK code is itself rotationally 
invarianL 

As a final note, the assignment of the two coded bits, 
mi, mo, to the four constellation subsets is such that the 
intersubset Hamming distance is proportional to the iniersubset 
Euclidean distance squared (the proportionality factor is A;, 
the square of the minimum spacing of the constellation) as is 
normally done in coded QPSK systems. (See Fig. 4 for the 
coded bit assignment.) 

B. Pruning and Decoding 

Consider the process of signal detection when a soft decision 
QPSK decoder is incorporated into a system employing the 
previously described QAM modulator. First, in hard decision 
detection of QPSK or QAM signals, the received signal yk = 
xjt -f t^jL- is quantized, where the signal Xk belongs to the 
QPSK or QAM constellation (i.e., in the range of MOD [m]), 
and Wk is the noise. The ^quantization function provides an 
estimate of both the signal x'j^ and the data m' according to 
the relation i'^ = MOD (m'). For maximum likelihond (MI.) 
detection, the log-likelihood function - log(p(yjt|MOD(m))) 
is minimized over the possible messages me {0, 1}'^. where 
p(yfc |xjt) is the conditional probability of receiving yk given 
that Xk was Iransmined. For random messages, ML detection 
minimizes the probability of error. The most common method 
of quantization is nearest (Euclidean) neighbor detection, 
which satisfies 

||yfc-x'J' = min ||yjt - MOD(m)f 

where the minimum is taken over m 6 {0, 1}''', and |1 • ||^ is 
the Euclidean distance squared (i.e., the sum of squares). In the 
case of additive Gaussian noise, nearest neighbor detection is 
ML. 

In coded QPSK and QAM systems, soft decision informa- 
tion should be provided to the decoder for more effective 
decoding of the codeword. This soft decision information is 
often described as a symbol metric, which indicates the quality 
of deciding a particular symbol was sent when yk is received. 
For nearest neighbor decoding, the metric of choice is 

metric (j/jt;m) = ||yfc - MOD (m)f . 

(In practice, the metric itself is quantized for purposes of 
implementation.) In QPSK, for example, for each possible 
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Bg. 3. Modulation function for 16/32/64-QAM, 

message mi, mo € {0, l}^ the nearest neighbor metric ||yfc - 
MOD(mi,mol|') is the ML metric for additive Gaussian 
noise. 

In coded QAM modulation based on a soft-decision de- 
codable QPSK code, four symbol metrics must be supplied 
to the decoder as well as four conditional hard decisions 
("uncoded" bits). For nearest neighbor detection, for each 
choice of mi.mo € {Oil}' 

metric (yfc;mi, mo) 

= min llvfe - MOD(miv-i,---,m2,mi,mo)ll 

where the minimum is taken over mw.i,---,m2 € 
{0,1}'^'-'. The conditional hard decisions correspond to 



Fig. 4. ie/32/64-QAM mapping. 



the choice of m^_i,--*,m2 that obtain the minimum. The 
process of detenmining the symbol metrics and conditional 
hard decisions is known as pruning. In trellis-coded QAM. 
the uncodcd bits appear as "parallel" branches of the trellis; 
the computation of the symbol metrics and conditional hard 
decisions act to prune all but the single best branch from the 
set of parallel branches. 

Once the pruning operation has been completed, the soft 
decision information is presented to the decoder of the QPSK 
code. During this time, the conditional hard decisions arc 
stored (delayed) until QPSK decisions become available. The 
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Bg. 5. Trellis decoder for 16/32/64-QAM- 



QPSK decoder, using the soft decision information, decodes 
the QPSK information (i.e. /mi, mo). The remaining informa- 
lion (i.e., m/v-ir • • i^^z) is then decided using the decoded 
QPSK information and the previously stored conditional hard 
decisions. 

Note that if the QPSK decoder is ML (for QPSK modula- 
tion), then the pruning/QPSK decoding method is also ML. For 
example, if the QPSK code is a binary convolutional code with 
nearest neighbor (Viterbi) decoding, then the aforementioned 
QAM decoding algorithm is also nearest neighbor (i.e., finds 
the closest codeword to the received sequence) (7]-[91. 

Fig. 5 shows a decoder implementation for 16/32/64-QAM. 
Notice that QPSK-based trellis codes allow a very practical 
trellis decoder design. The Viterbi decoder can be the "stan- 
dard" off-the-shelf variety instead of a custom part (as would 
be the case if. say, a rate 2/3 convolutional code were used). 

V. PERFORMANCE RESULTS 
Using (I). (2). and (6) with A<, = 2 (i.e., constellations 
based on the odd integer lattice), the performance of QAM- 
based trellis coded modulation (TCM) using nvo different 
convolutional codes is plotted in Fig. 6. Jhe-jatr \0. code- is. 

jhi>J^^MnyiprH" fid,gtaf^ rp^jfi y/Ul^ nrfal gffn''rr?f9r ^^^'0^ ^^'^^ 

tti]f^..nf1 try Qri^nwaiHyr [5]. Th? r^^''?r^ ''"^ff if^^ I6*^e 
code with octal generator matrix r ows [5 J — ?] and [2 — 3 
Q] found hy tJngerboeck f9l. In this paper, thfi raK l/2C0<je is 
referred to as the "pract jcal" code , and the rate 2/3co<^g is re- 
ferred to as the "Ungerboeck"code . The Ungerboeck code was 
chosen because it requires a Viterbi decoder whose complexity 
is about the same as the decoder for the practical code. 

For the concatenated system, the error rate of interest is 
the Reed-Solomon (RS) code block error rate. The reason the 
block error rate was chosen as the error rate of interest, as 
opposed to bit error rate, is because it is natural to block code 
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Rg. 6. Theoretical TCM perfonnarKC using two different convolutional 
codes. 

HDTV lines of data, and when an uncorrectable RS symbol 
error occurs in the line, some action is taken regardless of the 
number of bit errors lha: occuaed. The block error rate can 
be approximated by 

where L is the RS block length (number of m-bit symbols per 
block), and t is the number of RS symbol errors that can be 
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Fig. 7- •ni eoreiicM RS+ TCM performance using two different convolu- 
' Uonal codes. 




COlTCCtcd per block, P^Ssym the probability of an m-bit ^.^ ^ ^gin^a^ TCM perfonnance using two different convolutional 

RS symbol being in error, and is approximated by codes. 



^RSsym-l-(l-^")" 



n/n 



(8) 



where P„ is the n-bil symbol eaor rate out of the trelhs 
decoder. (Note that the above approximations assume that the 
channel is memorylcss.) ^it^PS.. 
Based on m r y prri r nrr vn rh viH^^ rflmprps^mn systems. 

fhre5;hold, If blocks arc transmitted at the NTSC TV horizontal 
line rate of 15.734 kHz, a lO'^ block error rate ,£(2iK5Efllld5 
.hnnt onP, hlnck crTQt DemuQUlg. If in addition the baud 
rate is restricted to 5 MHz (sufficient for transmission over a 6 
MHz NTSC channel), then it is required that each of the three 
TCM's corresponding to three, four, and five RS coded bits per 
symbol (16. 32. and 64-QAM. respectively) be concatenated 
wiih RS codes with block lengths of 120. 160. and 200 RS 
symbols, respectively. Commercial RS chips that can correct 
five, eight-bit symbol errors are readily available. Therefore 
the RS codes (over GF[256]) chosen for concatenation with 
the 16. 32. and 64.QAM TCM's are RS(120. 110). RS(160, 
150). and RS(200. 190), respectively. 

Fia. 7 shows the theoretical performance of concatcnatmg 
the aforementioned RS codes with practical and Ungerboeck 
trellis codes. Notice that all practical codes are better at a block 
error rate of 10*^ or more. However, simulations reveal even 
bcner results for practical codes. ^ 

Fig. 8 compares the simulated perfomiance of the practical 
and Ungerboeck codes. Notice here that the curves cross at 
10--^ compared to the theoretical curves in Fig. 6. which cross 
near 10"^ This result is reflected in the concatenated case, 
shown in Fig: 9. where the practical codes are shown to be. 
better than the Ungerboeck codes at a block error rate of 10 
or more. This clearly shows the performance advantage of the 
practical codes. 
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F,g. 9. Simulated TCM+ calculated RS performance using two different 
convolutional codes. 

VI. SUMMARY 

In this paper, it was argued that for concatenated cod- 
ing systems employing QAM-based trellis coded modulation, 
optimization of coding gain is achieved by analysis of the 
number of nearest neighbors, where as for nonconcatcnatcd 
systems the ACG is the parameter of interest. A practical 
concatenated coding scheme based on a QPSK trellis code 
employing a "standard" rate 1/2 64.state code was shown to 
petform better than a rale 2/3 I6.state code. Fuithem^ore the 
practical scheme has a distinct implementation advantage over 
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Other trellis coding schemes due to the fact that a standard 
off-the-shelf Viterbi decoder can be used in the trellis decoder 
rather than a custom part. 
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